A posteriori agreement as a quality measure for readability prediction systems

All readability research is ultimately concerned with the research question whether it is possible for a prediction system to automatically determine the level of readability of an unseen text. A significant problem for such a system is that readability might depend in part on the reader. If different readers assess the readability of texts in fundamentally different ways, there is insufficient a priori agreement to justify the correctness of a readability prediction system based on the texts assessed by those readers. We built a data set of readability assessments by expert readers. We clustered the experts into groups with greater a priori agreement and then measured for each group whether classifiers trained only on data from this group exhibited a classification bias. As this was found to be the case, the classification mechanism cannot be unproblematically generalized to a different user group

Technology for large-scale translation of clinical practice guidelines : a pilot study of the performance of a hybrid human and computer-assisted approach

Background: The construction of EBMPracticeNet, a national electronic point-of-care information platform in Belgium, was initiated in 2011 to optimize quality of care by promoting evidence-based decision-making. The project involved, among other tasks, the translation of 940 EBM Guidelines of Duodecim Medical Publications from English into Dutch and French. Considering the scale of the translation process, it was decided to make use of computer-aided translation performed by certificated translators with limited expertise in medical translation. Our consortium used a hybrid approach, involving a human translator supported by a translation memory (using SDL Trados Studio), terminology recognition (using SDL Multiterm termbases) from medical termbases and support from online machine translation. This has resulted in a validated translation memory which is now in use for the translation of new and updated guidelines. Objective: The objective of this study was to evaluate the performance of the hybrid human and computer-assisted approach in comparison with translation unsupported by translation memory and terminology recognition. A comparison was also made with the translation efficiency of an expert medical translator. Methods: We conducted a pilot trial in which two sets of 30 new and 30 updated guidelines were randomized to one of three groups. Comparable guidelines were translated (a) by certificated junior translators without medical specialization using the hybrid method (b) by an experienced medical translator without this support and (c) by the same junior translators without the support of the validated translation memory. A medical proofreader who was blinded for the translation procedure, evaluated the translated guidelines for acceptability and adequacy. Translation speed was measured by recording translation and post-editing time. The Human Translation Edit Rate was calculated as a metric to evaluate the quality of the translation. A further evaluation was made of translation acceptability and adequacy. Results: The average number of words per guideline was 1,195 and the mean total translation time was 100.2 min/1,000 words. No meaningful differences were found in the translation speed for new guidelines. The translation of updated guidelines was 59 min/1,000 words faster (95% CI 2-115; P=.044) in the computer-aided group. Revisions due to terminology accounted for one third of the overall revisions by the medical proofreader. Conclusions: Use of the hybrid human and computer-aided translation by a non-expert translator makes the translation of updates of clinical practice guidelines faster and cheaper because of the benefits of translation memory. For the translation of new guidelines there was no apparent benefit in comparison with the efficiency of translation unsupported by translation memory (whether by an expert or non-expert translator

An intact signal peptide on dengue virus E protein enhances immunogenicity for CD8+ T cells and antibody when expressed from modified vaccinia Ankara

Dengue is a global public health concern and this is aggravated by a lack of vaccines or antiviral therapies. Despite the well-known role of CD8(+) T cells in the immunopathogenesis of Dengue virus (DENV), only recent studies have highlighted the importance of this arm of the immune response in protection against the disease. Thus, the majority of DENV vaccine candidates are designed to achieve protective titers of neutralizing antibodies, with less regard for cellular responses. Here, we used a mouse model to investigate CD8(+) T cell and humoral responses to a set of potential DENV vaccines based on recombinant modified vaccinia virus Ankara (rMVA). To enable this study, we identified two CD8(+) T cell epitopes in the DENV-3 E protein in C57BL/6 mice. Using these we found that all the rMVA vaccines elicited DENV-specific CD8(+) T cells that were cytotoxic in vivo and polyfunctional in vitro. Moreover, vaccines expressing the E protein with an intact signal peptide sequence elicited more DENV-specific CD8(+) T cells than those expressing E proteins in the cytoplasm. Significantly, it was these same ER-targeted E protein vaccines that elicited antibody responses. Our results support the further development of rMVA vaccines expressing DENV E proteins and add to the tools available for dengue vaccine development.Parts of this work were supported by the InstitutoNacional de Ciência e Tecnologia de Vacinas–INCTV (National Insti-tute of Science and Technology of Vaccines) and by a FAPEMIGPPM grant (CBB, PPM-00461-11). BRQ was a CAPES/PDSE fellow-ship recipient (8815-11-9). FGF is a CNPq fellowship recipient. DCTis an ARC Future Fellow (FT110100310)

Design and Use of a Systematic Site Visit Protocol: Implications for Novice Evaluators and Mentors

Site visits are frequently used by evaluators to gain first-hand experience and knowledge about program implementation. However, few peer-reviewed articles describe the procedures used for designing and conducting site visits. This article describes the process of constructing and using a systematic site visit protocol. Theories and concepts of evaluation, including the measurement of fidelity and quality and the importance of context to site-level implementation, guided the construction of this protocol. Using a systematic method for program inquiry can improve the consistency of qualitative observations of program activities by enhancing intentionality, transparency, and emergence within the site visit process. The method presented may be especially helpful to novice evaluators and their mentors in learning about and teaching the process of conducting site visits

Colour stability and water-holding capacity of M. longissimus and carcass characteristics in fallow deer (Dama dama) grazed on natural pasture or fed barley

The effects of feeding regimen on carcass characteristics, meat colour and water-holding capacity of M. longissimus were studied in 24 female fallow deer (Dama dama). All animals were farm raised; twelve were grazed on pasture and twelve were fed barley and a small amount of hay prior to slaughter. The animals were slaughtered at two occasions (during the Southern Hemisphere spring); after 19 weeks of feeding (n=12; 6 grazing and 6 barley fed animals; group 1) and after 24 weeks of feeding (n=12; 6 grazing and 6 barley fed animals; group 2). The barley/hay-fed deer had significantly higher body condition scores and carcass weights than the pasture raised group. No difference in meat ultimate pH values between the treatment groups was recorded. The meat from the pasture raised deer had significantly longer colour display life after 2 and 3 weeks of refrigerated storage (+ 2.0 ºC) in vacuum bags. There was no difference in drip loss between the two treatment groups. However, significantly lower drip losses were found in meat from the animals in group 2 compared with the ones in group 1 (P ≤ 0.001). It was concluded that the feeding regimen of the animals is an important factor that contributes to the variation in quality of fresh chilled deer meat (venison), mainly the colour stability and display life of vacuum packaged meat.Abstract in Swedish / Sammanfattning: I denna undersökning ingick 24 dovhjortshindar (Dama dama) för att studera effekterna av olika typer av foder (bete och korn) på slaktkroppskvalitet samt färg och vattenhållande förmåga i köttet (M. longissimus). Alla djur var uppfödda på en hjortfarm, 12 betade gräs och 12 utfodrades med korn och en liten mängd hö före slakt. Djuren slaktades vid två olika tillfällen (under våren på det södra halvklotet); efter 19 veckors utfodring (n=12; 6 betesdjur och 6 kornfodrade djur; grupp 1) och efter 24 veckors utfodring (n=12; 6 betesdjur och 6 kornfodrade djur; grupp 2). De dovhjortar som utfodrats med korn och hö var i bättre kondition och hade högre slaktvikter jämfört med de djur som betat gräs. Ingen skillnad i köttets pH-värde mellan de två utfodringsgrupperna kunde dock påvisas. Köttet från de betande dovhjortarna hade bättre färgstabilitet efter lagring i 2 och 3 veckor (+ 2.0 ºC) i vakuumförpackning. Det fanns ingen skillnad mellan kött från betande och korn/hö-utfodrade djur i vattenhållande förmåga. Däremot hade kött från djur i grupp 2 (slaktade efter 24 veckors utfodring) bättre vattenhållande förmåga jämfört med grupp 1 (P ≤ 0.001). Vi kunde konstatera att de olika fodertyperna påverkade kvaliteten hos färskt kyllagrat kött, framförallt färgstabiliteten hos vakuumförpackat kött

The Digital Flynn Effect: Complexity of Posts on Social Media Increases over Time

Parents and teachers often express concern about the extensive use of social media by youngsters. Some of them see emoticons, undecipherable initialisms and loose grammar typical for social media as evidence of language degradation. In this paper, we use a simple measure of text complexity to investigate how the complexity of public posts on a popular social networking site changes over time. We analyze a unique dataset that contains texts posted by 942, 336 users from a large European city across nine years. We show that the chosen complexity measure is correlated with the academic performance of users: users from high-performing schools produce more complex texts than users from low-performing schools. We also find that complexity of posts increases with age. Finally, we demonstrate that overall language complexity of posts on the social networking site is constantly increasing. We call this phenomenon the digital Flynn effect. Our results may suggest that the worries about language degradation are not warranted

Introducing a framework to assess newly created questions with Natural Language Processing

Statistical models such as those derived from Item Response Theory (IRT) enable the assessment of students on a specific subject, which can be useful for several purposes (e.g., learning path customization, drop-out prediction). However, the questions have to be assessed as well and, although it is possible to estimate with IRT the characteristics of questions that have already been answered by several students, this technique cannot be used on newly generated questions. In this paper, we propose a framework to train and evaluate models for estimating the difficulty and discrimination of newly created Multiple Choice Questions by extracting meaningful features from the text of the question and of the possible choices. We implement one model using this framework and test it on a real-world dataset provided by CloudAcademy, showing that it outperforms previously proposed models, reducing by 6.7% the RMSE for difficulty estimation and by 10.8% the RMSE for discrimination estimation. We also present the results of an ablation study performed to support our features choice and to show the effects of different characteristics of the questions' text on difficulty and discrimination.Comment: Accepted at the International Conference of Artificial Intelligence in Educatio

Non-Detection of Methane in the Mars Atmosphere by the Curiosity Rover

By analogy with Earth, methane in the atmosphere of Mars is a potential signature of ongoing or past biological activity on the planet. During the last decade, Earth-based telescopic and Mars orbit remote sensing instruments have reported significant abundances of methane in the Martian atmosphere ranging from several to tens of parts-per-billion by volume (ppbv). Observations from Earth showed plumes of methane with variations on timescales much faster than expected and inconsistent with localized patches seen from orbit, prompting speculation of sources from sub-surface methanogen bacteria, geological water-rock reactions or infall from comets, micro-meteorites or interplanetary dust. From measurements on NASAs Curiosity Rover that landed near Gale Crater on 5th August 2012, we here report no definitive detection of methane in the near-surface Martian atmosphere. Our in situ measurements were made using the Tunable Laser Spectrometer (TLS) in the Sample Analysis at Mars (SAM) instrument suite6 that made three separate searches on Martian sols 79, 81 and 106 after landing. The measured mean value of 0.39 plus or minus 1.4 ppbv corresponds to an upper limit for methane abundance of 2.7 ppbv at the 95 confidence level. This result is in disagreement with both the remote sensing spacecraft observations taken at lower sensitivity and the telescopic observations that relied on subtraction of a very large contribution from terrestrial methane in the intervening observation path. Since the expected lifetime of methane in the Martian atmosphere is hundreds of years, our results question earlier observations and set a low upper limit on the present day abundance, reducing the probability of significant current methanogenic microbial activity on Mars

Kink stability, propagation, and length scale competition in the periodically modulated sine-Gordon equation

We have examined the dynamical behavior of the kink solutions of the one-dimensional sine-Gordon equation in the presence of a spatially periodic parametric perturbation. Our study clarifies and extends the currently available knowledge on this and related nonlinear problems in four directions. First, we present the results of a numerical simulation program which are not compatible with the existence of a radiative threshold, predicted by earlier calculations. Second, we carry out a perturbative calculation which helps interpret those previous predictions, enabling us to understand in depth our numerical results. Third, we apply the collective coordinate formalism to this system and demonstrate numerically that it accurately reproduces the observed kink dynamics. Fourth, we report on a novel occurrence of length scale competition in this system and show how it can be understood by means of linear stability analysis. Finally, we conclude by summarizing the general physical framework that arises from our study.Comment: 19 pages, REVTeX 3.0, 24 figures available from A S o

Nonadiabatic Dynamics of Ultracold Fermions in Optical Superlattices

We study the time-dependent dynamical properties of two-component ultracold fermions in a one-dimensional optical superlattice by applying the adaptive time-dependent density matrix renormalization group to a repulsive Hubbard model with an alternating superlattice potential. We clarify how the time evolution of local quantities occurs when the superlattice potential is suddenly changed to a normal one. For a Mott-type insulating state at quarter filling, the time evolution exhibits a profile similar to that expected for bosonic atoms, where correlation effects are less important. On the other hand, for a band-type insulating state at half filling, the strong repulsive interaction induces an unusual pairing of fermions, resulting in some striking properties in time evolution, such as a paired fermion co-tunneling process and the suppression of local spin moments. We further address the effect of a confining potential, which causes spatial confinement of the paired fermions.Comment: 4 pages, 5 figure